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ABSTRACT 


Generally, classical polynomial splines tend to exhibit unwanted undulations. In 
this work, we discuss a technique, based on control principles, for eliminating these 
undulations and increasing the smoothness properties of the spline interpolants. We 
give a generalization of the classical polynomial splines and show that this general- 
ization is, in fact, a family of splines that covers the broad spectrum of polynomial, 
trigonometric and exponential splines. A particular element in this family is deter- 
mined by the appropriate control data. It is shown that this technique is easy to 
implement. 

Several numerical and curve-fitting examples are given to illustrate the advantages 
of this technique over the classical approach. Finally, we discuss the convergence 
properties of the interpolant. 
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CHAPTER I 
INTRODUCTION 


In this work, we study the control problem 

^x{t) = Ax(t) + Bu{t), (1.1) 

at 

y(t) = Cx(t) 

with the cost function 

J(u)= [±Pl\n^dt. ( 1 - 2 ) 

Here, x G R m , y 6 R p , u € L 2 (D, R*) t i G Q C R, and A e £(R m , M m ), 5 G £(R', R m ) 
and C e £(R m ,R p ). The vectors x and u are the state and control vectors of the 
system, respectively. A is called the state matrix, B the control matrix and C the 
observation matrix. 

Our goal is to find the control u that will drive the system from one point to the 
other in the state space R m and at the same time minimizes the cost function J(u). 
We will also establish controllability conditions of the system (given the cost function 
J(u)) and then apply the results to spline approximation problems. 

It has been shown [13] that the system (1.1) is controllable if and only if the 
matrix 

Z = ( D AB ... A m ~ 1 B ) (1.3) 

has rank m and that 

M = {(A, B) : x = Ax + Bit is controllable} (1.4) 

is a manifold in R m ( m+/ ) [14]. Anderson and Moore [2], Luenberger [23], and Sage 
[28] have dealt extensively with the optimal control problem when the cost function 
is J(u) = Inii 2 dt (the minimum energy problem). Conditions for controllability of 
the system are also given [23]. 

Spline interpolation constitutes a class of piecewise polynomial approximation 
that is commonly used when approximating many of the functions that arise in ac- 
tual physical processes. Spline approximations of functions are preferred to most 
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approximation and interpolation methods because of their inherent smoothness prop- 
erties [10]. In [21], the minimal property associated with spline approximation is 
shown. A great deal of work has been done on polynomial splines, particularly cubic 
splines [11]. In [6] the convergence properties of a special class of quintic splines are 
discussed. There is a small amount of literature on exponential splines [7, 15, 24, 26]. 
McCartin [24] has given an excellent theortical discussion of exponential splines and 
also studied its convergence rates and extremal properties. Pruess [26, 27] asserts 
that exponential splines can produce co-convex and co-montone interpolants. 

In their paper [30], Zhang, Tomlinson, and Martin show the relationship between 
control theory and spline approximation by studying the minimum energy problem, 

namely: minimize 

f T 

J(u)= / u 2 (s)ds 
Jo 

subject to 

-7 -x(t) = Ax(t ) + bu(t), t G [0, T] 
at 

or equivalently 

x(t) = e At x(0) + t e A ^- 3) bu(s) ds. 

Jo 

In this case, they obtained the optimal control law by observing that the operator 

K : L 2 [ 0, T] — * R m 


defined by 


has an adjoint given by 



for any z G R m . Thus, the optimal control can be written as 


u = K*{I<K*)- l (x(T ) - e AT x(0)). 


(The interested reader should see Luenberger [23] or any other standard text on 
functional analysis for more details.) By imposing certain smoothness requirements 
on u(t ), they were able to obtain the spline functions. However, this approach does not 
eliminate the undulations associated with classical polynomial splines. In an attempt 
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to overcome this problem, we introduce into the cost function, J(u), derivatives of 
the control law u(t) and hence, formulate our problem in the sobolev space H n (Q). 

In this work, we intend to use optimal control theory to develop methodology for 
spline approximations. As an illustration, suppose that the write-head of a computer 
is required to move from a certain position, x(to), to another position, x(T), then 
some control u(t ) is needed to drive the write-head from the initial state, x(0), to the 
final state, x(T). Thus, the write-head (the system) must go through a certain set of 
points, namely, 

(to,x(to)), (tl, 2 -(^l))) • • - j (^n— 1 ) x(t n — i)), (t n , x(t n )) 

0 = to < ti < . . . < i n _ i < t n = T 

at given times. A spline curve can be fitted through these data points and then a 
control that takes the system through this trajectory determined. We hope to find 
the set of controls 

m(t) : “4 1 x(u) 

that achieves this while minimizing the functional J(u). Then, by applying the appro- 
priate smoothness requirements of u(t) at the endpoints of each subinterval, t»] , 
we will obtain and characterize the class of spline approximations. Numerical exam- 
ples will be given to demonstrate the advantages of this technique. 

The work has been divided into several parts. In Chapter II, we formulate the 
control problem in the space 

H n (Q) = {u£ L 2 (Ct)\D j u € je Z, 0 < j < n}. 

We also discuss some of the basic concepts in systems theory and control. Further- 
more, a brief discussion of some of the properties of the space // n (f2), including the 
relevant embedding theorems, is given. In Chapter III, optimal control is discussed. 
The control problem is transformed into a system of boundary value problems and, 
by applying standard techniques for solving DVPs, the desired optimal control law 
is obtained. Chapter IV deals with the derivation of spline functions by imposing 
appropriate smoothness conditions on the optimal control law obtained in Chapter 
III. The splines are then classified by studying the structure of the basis functions. 
Finally, in Chapter V, results of computer simulations and a discussion of rates of 


convergence are given. 



CHAPTER II 

FORMULATION OF THE PROBLEM 


2.1 Motivation 

In order to motivate the importance of developing the relationship between control 
theory and spline functions, we first present an example that is of great practical 
importance. 

Example 2.1 The dynamics of a computer disk drive. 

Consider the disk-drive of a computer system. It can be modelled as an inertia system 
with governing equation given by: 

M(0)e + C(O,0)O + K(O)O = f(O) (2.1) 

where M{9) represents a generalized inertia term and is positive definite, C{9, 9) is 
generalized damping function, K{9) is a generalized stiffness function, and f(9) is a 
forcing function. Linearizing the system at 0, we obtain 

x + H,x + H 2 x = M~\ 0)/. (2.2) 

Transforming equation (2.2) into a system of first-order equations, we obtain 

'z = Az + Bf (2.3) 

where z = (xx,a: 2 ) r , aq = x, x 2 = x 



Equation (2.3) expresses the system dynamics in state-space form. Now, suppose that 
the write-head is required to move from a certain (initial) position, z(to), to another 
(final) position, z(t f ). Then, the input function, /, must be chosen appropriately 
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to drive the system from the initial state, z(t 0 ), to the final state, z(t f ), following a 
certain trajectory. Thus, the write-head must pass through a certain set of points 

(to, , (t n , z(t n )), 

0 = < t\ < . . . < in- 1 < in “ 

at given times. A spline curve can be fitted through this set of points and then 
a control that takes the system through this trajectory determined. We can find 
several such functions, /, that will drive the system through the specified set of 
points. However, a more interesting problem is to find the function, /, that not 
only drives the system from one point to another in state-space but also minimizes 
a certain fuctional, J(f). This kind of problem will be solved in a general setting 
and by forcing / to satisfy certain smoothness conditions at specified points, we will 
obtain and characterize the class of spline functions. 


! 
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2.2 Basic Systems Theory Concepts in Finite-Dimensions 
In general, by time-invariant, finite-dimensional linear system B, C, D) on 

the state-space, X, we mean that X, U, and Y are finite-dimensional linear vector 
spaces and A, B, C, and D are bounded linear maps: A G £(X), B € C(U,X), 
C e C(X, Y) and D 6 C(U,Y). X = R m , U = R m , Y = R fc are called the state, 
input, and output spaces, respectively. Furthermore, the state x(t ) € X, the input 
u(t) e U, and the output y(t) G Y, are related by the equations 


x(t) = Ax(t) + Bu(t), 


t> 0, x(0) = x 0 


(2.4) 


y(t ) = Cx(t) + Du(t), (2-5) 

where x 0 G X is an arbitrary initial condition. If u G L 2 ([0, T]; B), then x G 
C([0,T];X) and y G L 2 ([0,T];X) are given by 

x (t) = e At x 0 + /J e A ^ a) Bu(s)ds (2-6) 

and t 

y(t) = Ce At x o + J Ce A{t - a) Bu(s)ds + Du(t) (2.7) 
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The frequency-domain representation of equation (2.7) is given by 

y(s) = Du(s) + C(sl - A)~ 1 Bu(s). (2.8) 

The above representation is obtained by letting f 0 = 0 in equation (2.7) and then 
taking Laplace transforms. Equation (2.8) can be written as 


y{s) = G(s)u{s) 


where 


G{s) = D + C(sl - A)- l B (2.10) 

is called the transfer function of the finite-dimensional system £(A,.B,C, D ) defined 
by equation (2.4). The transfer functions are proper rational matrices with com- 
plex coefficients. A theory for control design based on a transfer matrix description 
has been developed using the algebraic properties of the finite-dimensional transfer 
functions. In this work, we will base our analysis entirely on state-space theory. 


2.3 The Problem Statement 


Consider the linear system: 


-ff(i) = Ax (0 + hi(t), t E [0,T], 
at 


( 2 . 11 ) 


0 1 0 ... 0 

0 0 1 ... o 

A= ; • • : 

0 0 0 ... 1 

^ Ci\ ^3 * • * Q"m 

and the observation function 


, b= ! , x(t) = 


y(t) = ?x{t), 


%m — 1 if) 

%m (t) 


c‘ r = (l,0,...,0). 


Let the interval [0,T] be partitioned into p submtervals 


P : 0 — to < t\ <...< < tp — T, 
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and set hi = U - t { . t . Our objective is to determine the control element u(t) G 
C m_2 [0,T] that drives the system (2.11) from £(0) to £(T) such that the observed 
function y(t) satisfies the interpolation conditions 

y(ti)=a u * = 0, 1, . . . ,p — l,p. (2-14) 

Moreover, we require that u(t) minimize the cost function 

J(u)= rttiu^) 2 ] dt. (2.15) 

J ° \k=0 / 

(Notice that equation (2.15) is a special case of equation (1.2) where (3 = 1.) A control 
that achieves this objective is called optimal. Here, x, b G R m , u(t ) G L 2 [0,T] and 
A is an m x m matrix. We want to find the control law u(t ) that drives the system 
(2.11) from £(0) = £° to x(T) = d? and minimizes the functional J(u). Before we go 
any further, the following definition and theorem are in order: 

Definition 2.1 The linear system (2.11) is said to be controllable if for every pair 
of vectors ( x °,x r ) € R m , there exists a finite time T and a control u{t ) such that, 

x (T) = e^ T £° + J e A< ' T ~ s ^bu(s) ds. 


Theorem 2.1 The given linear system (2.11) is controllable if and only if the con- 
trollability matrix 

M = ( b Ab ... A m ~ l b ) (2.16) 

has rank m. We then say that the pair ( A,b ) is controllable. 

Example 2.2 Consider the system x(t) = Ax(t) + bu(t), x(0) = Xq. Let 


A = 


(0 1 0 \ 

0 0 1 


V o o o / 


andb = (001) r . Then 


rank(b, Ab, A 2 b) = rank 


0 0 1 \ 
0 l 0 

V 1 0 o 


= 3. 


(2.17) 


Hence, the pair ( A , b ) is controllable. 
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' The system (2.11) , with A, b as in equation (2.12), is controllable. This is a direct 

consequence of Theorem (2.1) since, in this case, the matrixM = ( b Ab ... A m ~ l b ) 
has full rank. Now, our problem is to minimize the functional J(u) subject to the 

constraint 

—x(t) = Ax(t) + bu(t), t € [0, T]. 
at 

We may replace this equation by the equivalent constraint 

x(t) = e At x 0 + e A ^~ a) bu{s) ds. (2.18) 

Then the control problem may be formulated in the space 

H n (Q) = {u € L 2 (ft)| D j u e L 2 (ft), ft C R, j e Z, 0 < j < n}. (2.19) 


H n (ty is the Sobolev space of order n on ft C R with inner product defined by 


{u,v) H n (n) - J o ( 5Z 


\k=0 


u (k) v W 


) 


dt 


( 2 . 20 ) 


and the corresponding norm 

IM| 2 *. ( n) = l T t I <•“> I 2 dt = t (2.21) 

Jo k = 0 k = 0 

Since our problem is formulated in the space H n (Q), it is appropriate that we state 
some of the properties of this space that will be most useful in solving our problem. 


2.4 Sobolev Spaces and Embedding Theorems 
In this section we will give some of the important results about the Sobolev space 
i/ n (ft) that will prove useful in this work. Sobolev spaces are very useful when a 
higher degree of smoothness is desired. On the other hand, a major problem with 
this space is that many of the operators that occur frequently in applications are not 
self-adjoint with respect to the Sobolev inner product. 

Definition 2.2 Let l > 0 be an integer; 1 < p < oo, ft C R m . 

W p "(ft) = {« € L p (ft)| 3 € L p (ft), Vo3|o|<n} 

C L p (ft) 


* 

i 


3 


0 
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with norm 

IMIw^(n) = ( / Y |P a u(i)| p df 

\ ° M<n 

If p = 2 and Q C R, then 

w;((i) = vf 2 "(q) = n n (o), 

i/ n (Q) = {u G L,2{Q)\Diu G £ 2 ( 0 ), J € Z, 0 < j < n}. 

with norm n 

ll u llif n (n) = £ 

Jfc=0 

and 

tf 0 "(Q) = {a G /T(Q)|D j u = 0 on 30,0 < j}. 

Definition 2.3 Suppose that Xi, || • ||i and X 2 , || • H 2 are Banach spaces and that 3 
a positive constant c < 00 such that ||x||i < c||x|| 2 , Vx G X 2 implies X 2 CX b then 
we say that X 2 is embedded in X x . Furthermore, the embedding is called compact if 

the unit ball 

B*'( 0) = {xG X 2 |||x|| 2 < 1} 

is compact in the space X x . 

Definition 2.4 Compactness Criterion in Hilbert Spaces. 

Let H be a Hilbert space and {<j>k}kL\ an orthonormal basis in H . Let B C H be a 
bounded subset of H. Define 

P n :H->H n = span{<f> k }? =l 



by 


n 

PnX = ^2,{x,(t>k)4>k 


jfc=l 


Pn : H —* — span{(f> k }^ n+l 

OO 

PnX = Yj ( X > 

A:— n+1 
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Furthermore, define 

e n (B) = siipHP^xll. 

xeB 

Then B is compact iff 

lim e n (B ) = 0. 

n— *oo 

Theorem 2.2 Let H be a Hilbert space with orthonormal basis Hi C H 

and Hi C H. Suppose that 

0 < Ai < A 2 < • • • A„ — ► oo 


0 < pi < pi < • ■ • p n -* °o 

and 

Mn n 

T * 00 

An 

Furthermore, let ||u||? = A*|(u, <t>k)\ 2 and ||u|t| = ET=i Fk\(n,4> k )\ 2 be norms in 

H { and H 2 , respectively. Then H 2 C H x and the embedding is compact. ■ 

Lemma 2.1 Let n 

Nli = E < 2 - 22 ) 

k=0 

Then (2.21) and (2.22) are equivalent. 

Theorem 2.3 The Sobolev space H n (Cl) is a Hilbert space. 

Proof: The proof of this Lemma is found in Aubin [3]. ■ 

Theorem 2.4 The space H n (Cl) is separable and reflexive. [l] 

Theorem 2.5 Extension Theorem for Sobolev Spaces. [1, 16] 

Let C R m and dCl piecewise smooth. Assume also that Cl C fii- For any fixed p,l, 
(1 < p < oo, / > 0, / € Z), 3 a bounded linear operator 

E : 

such that V u € (Eu)(x) = u(x), x € Q, and ||£‘m||iv'(I 1 1 ) < ^ll«ltiv;(n)- ■ 
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Now, consider the space L 2 (ft), where ft = [0,T] C R l . 

/ s 1 2xikt . — 

= ~Jf e T , keZ 

is an orthonormal basis in L 2 (ft)- So u £ £2 (ft) implies that 

u(f) = ^Ckfait) 


jtez 


= ”7= y c fc e 


2yifet 

T 


where 


c k = (u, <f) k ) 

= [ u(t)<i>k{t) dt 

J n 

= —= / u(t)e t 
s/TJn 


dt 


If u E Z/J(ft), then 


(0 


with 


\u 


llt-(n) = E 11^^111,(0) 

k - 0 

IMIls(n) = E Mt 


Jfc=0 


by Parseval’s equality. 

(ii) ^ e L 2 (^); therefore, since u <E HJ(ft), 


and 


dll 1 v — \ , 2 

, .du , . 2irih 


1^II 2 = EI^IW- 

at keZ 1 


lltf-nu = E 

fcez - 1 


(2.23) 


(2.24) 


(2.25) 

(2.26) 


(iii) Finally, 


(2.27) 
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This is true since D l u £ L 2 (fi). Hence, 


/ 1 v — v . 2wikt 

D l n^-7=Y1 A ^ e T 

VJ fcgZ 


where 

„ . . .2irik., 

A k = (D l u,<f> k ) = ( T )c fc , 

(2.28) 

Vu £ H2(Q). 

/ n \ n 



NlV (n ) = E (E** 

(2.29) 


fcez \i—0 ) 1=0 


Thus, there exist constants ct\,ct 2 > 0 such that 



«i(l + fc a ) n <X>”<aa(l + * 2 )" 

(2.30) 


;=o 


This establishes that the norm defined by 

IIMII//»(n) = XX 1 + fc2 )*l c fc| 2 

ke z 

is equivalent to the original norm 

= X/ 11-^ u IL 2 (n)- 

k = o 

Lemma 2.2 The embedding H£(Q) C is compact. 

Proof: By the above discussion, we have 

IMU'*-‘(n) = 51(1 + k 2 ) 1 1 |ci|“ 

i€Z 

= < 2 - 31 ) 

l€Z 

and 

IMIff»(n) = T.(l + fc‘) 1 |Q | 2 

ie z 

= £>M S , ( 2 - 32 > 

lez 

where X k = (1 + Ar) n_1 and p k = (1 + k 2 ) n . Thus, by Theorem (2.2) the embedding 
is compact since 

_ (1 + A 2 ) n 
A. “(1+t 2 )"- 1 


00 . 
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Theorem 2.6 The embedding H n (Q) C H n *(^) is compact. 


Proof: It is obvious that H n (Q) is embedded in H n l ( fi ) since 


IMIlf— ‘(H) < 

However, the compactness of the embedding is not so obvious. To prove this, we 
apply lemma (2.2). Let ft C f>x with ft C fix- By the extension theorem, 

E : ff"(Q) -> HZith) 


is bounded. By lemma (2.2), the embedding C : i) C Hq ! (^i) 1S compact. 

Now, let 


Clearly, 


Thus, the embedding 


u e fly- 1 (ft) • Ru = u|n 
|| Ru || // n— 1 (n) < ll"ll//"- l (n,)- 


tf n (fi) 4. flj(fti) C flr l («i) 4 H n-1 (Q) 


is compact and the proof is complete. 

Theorem 2.7 Let Q C R m be a bounded domain with dQ € C 1 . fa) If 2n > m, 
then H n (Q.) is embedded in C(ft) and the embedding is bounded; that is, there exists 
a constant C such that ||«||c(n) < C|M|n-ff» for all u e Furthermore, the 

embedding is compact (b) Ifn - f > r, then H’(Si) C CT (Si) and the embedding » 

compact . 

Proof: The proof of this Theorem is found in references [1, 16]. 
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2.5 Existence and Uniqueness of a Solution 
The set of elements u £ H n ( ft) satisfying the constraint (2.18) is a linear variety 
V in that is, 

V = {u € H n {n) : x{t) = f e A{t ~ s) bu{s)ds}, 

J 0 

U x = {w £ H n {tt):{u,w) = 0 VuGU}, (2.33) 

V = {ueH n {Q): x(t) = e M x 0 + J\ A ^- S) bu{s)ds}. 

Therefore, the control problem is equivalent to finding the element u € V of minimum 
norm. 


Theorem 2.8 The control problem (2.11), with A, b as in equation (2.12), has a 
unique solution. 


Proof. To establish the existence and uniqueness of a solution, it suffices to show 
that the linear variety V, as defined in (2.33), is closed. First, observe that V is 
nonempty since the system is controllable (by Theorem 2.1). Let {u n } be a sequence 
of elements from V converging to an element u. To show that V is closed, we need 
to prove that u £ V. Let 

y(t) = e At x 0 + J e A( - t ~ s ' ) bu(s)ds. (2-34) 

We must show that x(t) = y(t). 

y(t)-x n {t)= f e /1(t-3) 6[M(s) - u n (s)]ds. (2.35) 

Jo 

By Cauchy-Schwarz inequality, we have 


| y(t) - x „(() | 2 < (j‘ | ,) b I 2 ds)() I «(s) - ti„(s) | 2 is) 

< f 1 (E At(t ~ S) “ b) I 2 is /' 1 »(») - »„(») I 2 is 
Jo i ft k. Jo 


s /.xt 

c 


< 

< 

< 


!(*-«) 


k\ 


\\b\\) d S ||n-7 in || J 


(2.36) 


,2||A||(t- S 


^ds\\u — 7t n ||" 


m 


(e 2 ^'“ - l) ||u - «„|| 2 
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Since >1 € L(R m ), there exists a constant M < oo such that ||j4|| < M. Thus, 

I m - Ut) \ 2 < ^ (e“‘ - 1) II- - -nil 2 - (2- 37 ) 

Therefore, integrating from 0 to T, we get 

|| y~ Xn|| < C||tt - «n II ( 2 - 38 ) 

where C = (*£- (e 2MT - l) - T))*. Thus, 

|| J- i|| < ||?- xj + ||f„ -x|| < C||u-u„|| + ||f„ -x||. (2 39) 

Since u -» and £ -> £„ as n -* oo, we get y = x. ■ 



CHAPTER III 
OPTIMAL CONTROL 


Optimal control is a branch of modern control that provides analytical designs of 
a special type. In this case, the system is required to be the best possible system of 
a particular kind in addition to satisfying stability requirements and all the desirable 
constraints associated with classical control. Linear optimal control is a special type 
of optimal control in which the controlled system is assumed linear and the control 
element is forced to be linear. This leads to an output that is linearly dependent 
on the input. The linear nature of many engineering plants justifies the study and 

analysis of linear optimal control systems. 

To obtain the optimal control law we first reduce the control problem to a boundary- 
value problem. The resulting boundary-value problem is then solved using standard 
techniques. The embedding theorems of section (2.4) assures us that the solution of 
this boundary value problem is bounded. 


3.1 The Optimal Control Law 

In this section, we will determine the optimal control law for our system 

— x{t.) = Ax(t) + MO, t € ft, 


with cost function n 

•/(«)=/ S> (l T<«- 

yn fc =0 

The optimal control u(t) is the element u <E V of minimum norm, where V is given by 
equation (2.33). What follows is a construction of V L . For u, v e H n ([ 0, T]), consider 
the inner product (?t, v) H "(a)- If we integrate this by parts, we obtain 


<-, = r±u^<is=±j\^ds 

k ~ 0 k=0 


(3.1) 


f T 

= / uv ds + > , 

J o k = 1 


f v {2k) uds + ^2(-l) k 3 v 

J 0 j = 1 


1)|T 


= f V(-i)S (2fc )u + E 

fc= 0 \J = 1 
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= f T T{-l) k V^ k) U ds + [n (1) u + V { 2 ) u w - v (3) u + . . . + V {n) u {n 1} - 
Ja k = 0 


^(n+D^n-2) + _ + | T 


Now, we want to minimize 


J(u) = ( U , 


subject to 


g(u) = e~ AT x(T) - x(0) - j e As bu(s)ds - 0. 


To this end, we let 

L(u, A) = J(u) + A T g(u) 

where A is the optimizing vector. Therefore, the optimal control law is obtained by 
solving the following equations 1 : 

dL(u, A) 


du 


= 0 


dL(u, A) 


d\ } 


= 0, j = 1,2, ... ,m 


Using equation (3.1) in the above equations, we obtain the following boundary- value 
problem: 

£(-l ) fc u< 2fc) = A T e~ At b 
fc= o 


Notice that 


L{u, A) = J _ A> ^j u ( s ) ds+ 


fc=l \ j=l 


and, hence, 


dL(u, A) 


= [ T 

\*=o / 


Sii 


ds 


A) 

<9 A, ~ 


= 3j(w). J = !. 2. 


m 
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^(-l)*- 1 #' 5 *- 1 ' |ot = 0 

^(-l) fc - 1 n< 2fc) |o,t = 0 

I 

: (3.2) 

£(-l) l -'it ( “ +n - 3 Mo,r = 0 

k= 1 

V (n} |o,r = °- 

We will show that the BVP (3.2) has a unique solution. This is not surprising 
since we are dealing with a system that is controllable. Furthermore, it will be shown 
that the solution of equation (3.2) is a function of X and t namely u(A, t). Then, the 
desired optimal control law will be given by 

= ( 3 - 3 ) 

where A* is the vector A th&t satisfies 

[‘ <.-d*Su(X, s) ds = e~ AT x(T) - e~ M °x(t a ). (3.4) 

Jo 

Now, if we let 

u = tpi 
u (1) = = V>2 

U (2n_1) = V4n— 1 = ^2n 


u< 2n) = 

^ = (_l)2n u 2(n-l) + . . . + (-l) n+3 U (4) + 

(-l) n+ V 2) + (-l) n+1 u + (-1 ) n X T e- Al h, 

(3.5) 

then the differential equation reduces to the following system of first-order 

linear 

differential equations: 

V(t) = F^{t)+a{t) 

(3.6) 


BV{t) | 0 = B 0 ^{t) = 0 

(3.7) 


BV(t) |r = Br*{t) = 0, 

(3.8) 


S5T 
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where 


$(t) = {A(t),Mt),---^2n{t)) T , 


a(t) = {-\) n b r e~ ATt \e 


2 n 


and e 2 „ is the 2 n - vector with 1 at the 2 n - th position and zero elsewhere. 


F = 


0 

0 


1 

0 


0 

1 


0 0 \ 

0 0 


0 0 0 ... 0 1 

\2n 


(3.9) 


V (-i)» +i o (-i )" +2 ... Mr” o/ 


and 


/ 0 1 0 
0 0 1 


B = 


-1 

0 


0 

-1 


\ 0 0 0 0 0 . . 


. ... (- l ) n ~ 2 o ' (- 1)"- 1 ^ 

. ... 0 ( I )"- 2 o 


(3.10) 


1 ... 0 0 0 ) 

By elementary row operation, the matrix, B , may be expressed in the equivalent form 

where 


bij = < 


1 if j = i + 1, i = 1, . . - , n 

(-l) n-i if j = 2n - (? — 1), i = 1, • • • ,n - 1 
0 otherwise. 


(3.11) 


Now, let $(t) be a fundamental matrix solution of the homogeneous BVP 

V{t) = F'V(t) (3.12) 

B 0 V(t) = J3*(0) = 0 (3.13) 

B T *(t) = BV(T) = 0 


(3.14) 
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with $(0) = /. The general solution of equation (3.6), when it exists, then satisfies 

¥(i) = ${t)c+ *°(t) (3-15) 

where . 

ip 0 (t) = <P(t) I '(s)ct(s) ds (3.16) 

Jo 

is a solution of equation (3.12) with *°(0) = ft and c is an arbitrary element of R 2n . 
Therefore, the boundary conditions (3.13), (3.14) become 

B o mt)c + V 0 (t)) = Bc = Q (3.17) 


B T mt)c + 'T(t)) = (Br*{t))c 4- BrV°{t) = 0. 
This gives the following system of equations 


B 


0 


c — 

Ti 


where Tj = — Br^ ,o (0- For a convenient notation we let 

If = 

and 


B 


r = 


o 

Ti 


Thus, 


Hc = r. 

Let us discuss the following important lemmas before going any further. 
Lemma 3.1 The matrix F has 2 n linearly independent eigenvectors. 
Proof: From 

det{pi - F) = 0 

we obtain the characteristic polynomial of F as 

/? 2„+2 + (_ 1 )n 

p 2n - p 7n - 2 + ■■■ + (-i) n = - -pn^r~ = °- 


(3.18) 


(3.19) 


(3.20) 


(3-21) 


(3.22) 
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Solving equation (3.22), we see that the eigenvalues of the matrix F are 

p k = e C * + £i )ni , k = l,...,n,n + 2,...,2n + l. (3.23) 

Thus, F has 2n distinct eigenvalues. Now, solving 

W ~ F)P* = 0 (3 ' 24) 

gives the eigenvectors of F as 

/ 1 \ 

Pk 

Pi 


a k = l,2,...,n,n + 2,...,2n + l, j = l,...,2n (3.25) 


P,= | IP* 


PT ' 2 

K p 2 r l ) 

where p k , i is the first component of the eigenvector p k . Since the eigenvalues are all 
distinct and the eigenvectors are as in equation (3.25), we then have that the matrix 
F has 2 n linearly independent eigenvectors. 

Lemma 3.2 (Gantmacher [17]) For a nonsingular operator A, Ax = 0 implies x = 0. 

Lemma 3.3 When the system (2.11) is controllable, then the matrix H has full rank 
for all T > 0. 

Proof : Recall that 


H = 


B 

B${T) 


To prove this lemma, it suffices to show that null(H) = 0, by lemma (3.2). Without 
loss of generality, we take T = 1. Therefore, let x e null(H). Then 


and 


Bx = 0 

(3.26) 

Be F x = 0 

(3.27) 
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where F and B are given by equations (3.9) and (3.10), respectively. By using equa- 
tion (3.11), we see that Bx = 0 implies that 


( X 2 + (-1)" ^2n 1 

x 3 + (-l) n-2 a;2n-i 

Xj + (-l) n -0- 1 )x 2 „_(j-i) 

\ ^n-fl / 


(3.28) 


If we denote the columns of e F by Pj, j = 1, 2, . . . , 2n, then equation (3.27) may be 
written as 


{BP, BP 2 . . . BP 2n ) x = 0 


where . 

( P2j + (-l) n_1 P2nj ^ 

P3J + ( — l) n ~ 2 p2n— lj 

nn = 

Pi,J + (-l)' l_(,_1) P2n-(i-l)J 

\ Pn+1 / 

Thus, 

0 = (J3P t BP 2 . . . BP 2n ) x 

2n 

= Y. x i BP i 

j = i 

2n 

= + < = 1 - 2 "■ 

j=l 

From equation (3.28) 


(3.29) 


(3.30) 


*2n-0-D = (-1)'" +J+2 ^ 3 = l,---,n. (3.31) 

Thus, equation (3.30) becomes 
2n 

0 = Yl x i (P‘d + (-l) n-(,-1) P2n-(i-i)j) 

j = i 
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= Vx j (pij + (-l) n_(i " l W-(»-l)j)+ E X i fa + (- 1 ) n_(,_l) P2n-(i- 1 )j) 

S j=n+1 

= ±xj (ft,- + (-ir^w^iw) + 

j=i 


^(-l)- ( — J+1, Ij+l (pi,2n— j+l + ("I)” ( ‘ 1 W-(i-l»-J+l 


0 


j =1 


= (pi,l + (-l) n_(,_1) P2n-(»-l),l) ^1 + 

E (Pij + ( — I)"” ( * _ 1} P 2 n— (j— l),j + (-l)- (n - J+1) Pi, 2 „-j +2 +P 2 »-(i-l).*n-j+a) Xj 
= = 2,...,n. 


j=2 

= Hii.iXi + rriijXj, i 


(3.32) 


This yields the set of equations 

My = 0 

where y = (xi,X 2 > • • • >x n ) an( l = 

17lj, 1 = Pt.l + (-l) n_(i_1) P2n-(i-i),i * = !. • • ■ » n 

771 jj = Piyj + (-l) n ' (<_l W(i-l),i + (-l)- (n “ J+1) Pi,2n- J+ 2 +P2n-(i-l),2n-j+2 

i = 1,. • ..n; j = 2,...,n. 

Since Pj, Pj = (pij, • • • >P2n,j) T > are linearly independent, it follows that the columns 
of the n x n matrix M are also linearly independent. Hence, 

My = 0 


implies 


V = 0, 


that is, xi = x 2 = • • • = x„ = 0. But from equation (3.32) 


x 2 „— (j— i) =■ (-l)- n+J ' +2 *j j = !,•■-.»• 

Thus, x n +x = • • . = x 2n = 0 and x = 0. Therefore, nuZZ(ff) = 0. ■ 

Theorem 3.1 Consider the linear nonhomogeneous system of differential equations 

x 1 = A(t)x + b(t) ( 3 - 33 ) 
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where .4(1) 6 L,(M) and b(t) £ Li- Le( T : C R" fc continuous and linear. 
Further, let the solutions of (3.33) satisfy 

Tx(t) = r, ( 3 - 34 ) 

for any given re R n . Then the BVP (3.33), (3.34) ha, a unique solution for every 
r e R n and every b(t) € L x if and only if the corresponding homogeneous linear BVP 

x 1 = A(t)x ( 3 - 35 ) 

Tx(t) = 0 ( 3 - 36 ) 

has only the trivial solution x(t) = 0. 

Proof : The proof of this Theorem can be found in Bi'rnfeld/Lakshmikantham [8]. 


We now state the following: 

Theorem 3.2 The BVP (3.12), (3.13), (3.14) has a unique solution. 
Proof : The proof follows from Lemma (3.3) and Theorem (3.1). 
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— # 

3.2 Determination of the Optimizing Vector A* 

Let us now determine the vector A* that yields the optimal control u(i). First, 
we observe that when the conditions of theorem (3.1) hold and F given by equation 
(3.9), the unique solution of (3.12), (3.13), (3.14) is expressible in the form 

4 <(t) = $(* - _1 r + ’T(t) 

= e F{t - to) H~ l r+ I* e F{t ~ s) a(s)ds. (3.37) 

Jt o 

Thus, from equation (3.3), the optimal control is represented by 

u(t,\*) = e l T V(t,\*) (3.38) 

where the 2n- vector, e\, is the coordinate vector given by e[ = (1, 0, . . . , 0, 0) r . The 
vector A*, (hereafter, denoted simply A), that yields the optimal control is obtained 
by applying equation (3.4): 

e~ At, x(tf) - e~ At °x(to) = f 1 e~ As bu(s , A) da. (3.39) 

Jt 0 

For ease of notation, let 


A (to,tf) = e At, x(t f ) - e Mo x(t 0 ). 


(3.40) 


Thus 


A (t 0 ,*/) = 


f 1 ’ e~ As be$<i!{s)ds 
Jto 


e-H(? 

Jto 


,F(s-t 


Now, 


to) H~ 1 r+ r e F{s ~ r) d(r) dr ds 
Jto 

= f lf e~ A3 be{e F ^- to) H- l Y + 

Jto 

Jt 1 e~ A *bef ^ e F ^~ r ^ £?(?') dr ^ ds 

Jt e~ As b ^ e F( - s ~ r ^d(r)diJ ds 

= f tf e~ As b (e[ [' e F{s - r \~l) n e 2n X T e~ Ar bdr) ds 
Jtn \ Jto / 


(3.41) 
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= j\- A V +to) b[%e F,f f* e~ F T ‘e 2n (-l) n X T e- A{t0+r,) bdr^ ds' 

= e~ At0 (-l) n J* e- M 'b(e$e Fs ' J* e _Fr 'e 2 „A Te~ Mto+rf) bdiJj ds' 

_ f^e- As 'b(^e Fa ' J^' e- Fr 'e 2n b r e- ATr ' dr'^j ds' e ~ ATto A 


— e 

= e~ Ato G(h)e~ ATt °X 


where 


^e"^' dr' ds' 


G(fc) = (-1)" jf fee' v J‘‘ 

h = t f - t 0 ; r = t 0 + t\ and s = t 0 + s'. Similarly, 

f e- A ’b(^-^H-'T)ds = fe-^btfS'H-'r) 
J tn 


(3.42) 

(3.43) 


ds 


ds ) H_lr 

= e~ Ato ^j\- As 'b$e Fs ') ds'^j H~ l T 


= e~ At °K(h)H~ 1 r 
= e - At 0 K{h)w 2 r l 


(3-44) 


where 


K(h)= Je- M b fields' (3.45) 

and W 2 is the 2 nxn submatrix of H~ l given by [ll’i : fib] = H~ l . Now, r = (0, r,) r 
and the n-vector Ti is, (from 3.19), given by 

Ti = —Be Ftf [ ' e~ Fs a{s)ds 
J to 

= — Be Ft/ f h e- nto+s,) ff(t 0 + s')ds' 

Jo 

= —Be Fh [ h e~ Fs '{-\) n e 2 nX T e~ Mt0+s ' ) bds 

Jo 

= (-1 ) n+ 'Be Fh U\- F3 '? 2 nFe~ ATs ' ds'^J < ~ ATt0 \ 

- (_i) n+1 B j* e F{h ~ s ' ) e2 n $'e~ ATs ' dse ~ ATt0 A 
= Bn(h)e~ ATt °X 


(3.46) 
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where 

n (h) = (-l) n+1 j\ F ( h -^e 2n b r e~ ATs 'ds' (3.47) 

is a 2 n x m constant matrix. Substituting (3.46) in (3.44), we obtain 

f tf e~ As b (ef e Ft H~ l r) ds = e~ At °K(h)r](h)e- ATto X (3.48) 

JtQ ' ' 

where 

t 7(h) = W 2 £ft(h). (3.49) 

Thus, equation (3.41) simplifies to 

e~ At0 G(h)e- ATt0 A + e- Ato K(h)ri(h)e- ATto X = e~ At 'x(t f ) - e-*°f(* 0 ). (3.50) 

That is 

e~ Ata [G(h) + K(h)r](h)]e~ ATto X = [e~ At fx(t f ) - e~ Ato x (t 0 )}. (3.51) 

From equation (3.51), we obtain 

e~ At °Ce~ ATt °X(t 0 , t f ) = e~ Mf x(tj) - e~ Ata x(t 0 ) (3.52) 

where 

C = ( G{h ) + K(h) V (h)). (3.53) 

Equation (3.52) is a system of linear equations in Aj, i = 1, 2, ..., m. Hence, the 
optimal control law is obtained by substituting the solution A of (3.52) into (3.38). 

Theorem 3.3 The system (3.52) of linear equations has a unique solution. Further- 
more, the solution of (3.52) is given by X = (e~ Ato Ce~ ATt °y 1 A(t. 0 ,tf). 

Proof : This follows from the existence of the optimal control law. 

The preceding analysis leads to the following: 

Theorem 3.4 When the system (2.11) is controllable, the control that drives the 
system from x (t 0 ) to x(tf) and minimizes the cost function ,/(«) = /// ££ =0 (u*) 2 ds 
is given by 

u(t , A) = ef (e^-^H-'T + jf* e F(t ~ s) d{s) ds) (3.54) 

where t 6 [to,*/], <?(s) = (~l) n ef n X T e~ A3 b, and F, H, T am as given in (3.9) and 
(3.10). 
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Theorem 3.5 The following are equivalent: 

1. There exists a control u(t, A) such that 

x(T) = e AT x(ti) + f e A ( T ~ s) bu(s, A) ds 

J 0 

is satisfied for all x(T), x(0) and all T > 0. 

2. The BVP 

' f^{t) = Ftp + e 2n o 
< Bi>{ 0 ) = 0 
k Bj(T) = 0 

has a unique solution. Here, = {u,u^\ . . . ,u^ n ^) T , cr = (— l) n ? r e A { A, and 
F and B are as in equations (3.9) and (3.10). 

3. The matrix 2 

C = G{h) + K{h)rj(h) 

is nonsingular. 


2 From equations (3.43), (3.45), and (3.49), 

G(h)+K(h) V (h) = (-1)" /“' e~ A *be[e F> ( f dr - W 2 B f dp 

Jto W<o Jt ° 


CHAPTER IV 

APPLICATION OF CONTROL THEORY TO SPLINE APPROXIMATION 


In this section, we describe a procedure for constructing spline functions from 
control principles. 


4.1 Splines and Control Theory 

Theorem (3.2) implies that the optimal control law for the system (2.11) is unique 
and this control element is given by equation (3.54). Since a controHaw for the 
system exists, there exists a set of points x \ . . . 1 with x\ = a*, t - 0, 1, . . . ,p 

such that the solution of the system (2.11) satisfies x{ti) = x 1 , i = 0, 1, . . - LP “ 1 >P- 
By theorem (3.4), the control element that drives the system (2.11) from x 1 1 to f, 
i _ i, ,p, an d satisfies equation (2.13) is given by 




(4.1) 


where u t (t) is the restriction of u(t) on [U-iM- Now > we need to determine the 
unknowns x i , i = 0, 1, . . . , V- However, since x[ = a 4 , t = 0, 1, . . . , P, we only have 
_ l)(p + 1) unknowns to determine. This is realized from the (m - l)(p ) 
continuity conditions on the control u(t), namely, 

u { '\U) = ttSJiCti), r = 0,...,m-2, i = l,...,p-l (4.2) 

and 2(m - 1) conditions at t = 0 and at t = T. Now, from equation (3.54), 
u (t) = eT (e F(t - to) H- l r + e Ft £ e~ Fs d(s) ds} 

w (r)(t) = ef + e Ft F r e- Fs a(s)ds + Y^F J d {r ^~ 3 \t^ 

r = 0,. . . ,m - 2. 


(4.3) 

(4.4) 


Thus, 

_ gf + e Ft F r £ e~ Fs ^(s) ds + £ 1 j) (oj 

V J=0 (4.5) 
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r = 0, . . . , 77i — 2, t G [^t— 1 > U]- 


Similarly, 

4+\(0 = ^ 


f fe f '<'- , '>F r Hr + ' 1 r, +1 + e F, r J‘ e^a w (s) is + £ (1) j 

' ’ J "° (4.6) 


T — 0, . . . , TTl 2, t € [tj, ti+l] 
where, from equation (3.6) 

*(<) = (-l) n e 2 n X T e- At b 

and from equations (3.17) and (3.18) 

' B*(U-x) 


Hi = 


B$(U) 


(4.7) 


(4.8) 


and $(t) = e F <‘- t4 - l) . Thus, 

„«((,) = ef ( ."•F'H.-'rW + F r [“ *> + £ I (-*•») 

l ^i-i j=0 / 


r— 1 


ZZ 


(0 

»+l 


r— 1 


(<,) = eT F'ff- + \r(( j+1 ) + £ 


(4.10) 


3 = 0 


Substituting equations (4.9) and (4.10) in (4.2), we have 


( r i ’ 

e Fhi F r H~ l T(ti) + F r f' e F ^ffi(s) ds + f^ 

Ju~\ ji=0 y 


r — 1 


ef | F r -»f + \r(f, + ,) + £ F r 4+T 1_J) (*i) 

j=0 


r = 0, — 2, z = l,...,p — 1 

The first term on the right side of equation (4.9) is: 

ef e Fhi F r H~ 1 r(ti) = <?e Fh ' F r H~'r{U) 


(4.11) 


= e F e Fh 'F r H~ l 


Ti (U) 


(4.12) 
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If we set 


0 


H~ l = ( 4 - 13 ) 

where H[, H" are 2 n x n submatrices of H~\ we obtain 

= efe Fhi F r ff' , BQ(h i )e- ATti - l X(t i -i,t i ) (4-14) 

The second term in equation (4.9) is: 

e[F T e Fti e~ Fa a t (s)ds = ef F r e Ft ' £’ ^ Fs Z t (s) ds 

= eT F r e Fti [ U e- Fs e 2n {-l) n b r e- ATs \{U- l ,U)ds 

= (~\) n e r l F T e FU ^ e- Fl e 2 J r e- AT, dsj\(t i -uU) 

= (-l) n ef F r e Fh f e-^'e^e-^ 3 ' ds X(U-u U) 


= -e[ F r Q(h t )e- ATt '- l X(U-uU ) 

Finally, the third term in equation (4.9) is: 

eT£F>'<r '-»((,) = 


(4.15) 


j= 0 


J =0 


_ (_i)n+r-i^ Y^(-iyF j e 2n b r (A r - 1 - j ) T \{u) (4.16) 
j- 0 

On substituting equations (4.12), (4.15), and (4.16) into equation (4.11) we obtam 


e[[e Fh ' F T H" B,Q.(hi)e~ ATti ~ l — 

r m)t- AT “-' + (-l)” +r -‘ E(-iyFiei.S r (A'-'-0 T lA‘ = 

j= 0 

eT[F r H';i B l+ Mhi + i)e~ ATt ' + 

( _l)n+r-i F J e 2n h r (A r - 1 - J ) T ]A ,+1 

i=o 


(4.17) 
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From equation (3.52), 

A* = e A ‘ Tti ~ l C~ 1 (hi ) - f*" 1 ] 

Thus, equation (4.17) simplifies to 

—e[ M i (h i )e ATti -'C- 1 (h i )x i - 1 + 

%[M i (h i )e ATti -'C- l (h i )e- Allt + M l+1 (h i+l )e ATti C- l (h i+ J]? - 
ef Mi+i(hi+i)e ATti C~ 1 (h i+ i)e~ A,li+1 x i+1 = 0 (4.18) 


where 


hi — 


T- 1 


Mi = e Ffli F r HiBiQ(hi)e- ATti - 1 —F r £l(hi)e~ ATti ~ l +(—l) n+T - 1 £(-l ) J F J e 2 „h r (A r - 1 - J ) T 

j = o 

(4.19) 

and 

M i+1 = F r H? +l B i+1 n(h i+1 )e- ATt < + (-i)«^- l 2(-l yF’e 2n b r (A r - l ~i) T (4.20) 

3=0 

i = l,...,p — 1, r = 0, 1, . . .m — 2. 


Therefore, we can obtain the unknowns x x ,...,x p ~ 1 by solving the linear system 
(4.18). This enables us to define the control u(t) piecewise on the interval [0, T]. 
Further, the solution of the system (2.11) is given by 

x (t) = e At i? + [ l e A(t ~ a) bu(s) ds (4.21) 

Jo 

Now, from the structure of the state matrix A, we observe that x '(£) = x i+ \(t),i = 
l,...,m — 1. Thus, the continuity of x'^t) implies the continuity of aq + i(f) for i = 
l,...,m — 1. Also, the continuity of u^ r \t) implies the continuity of x\ m+r ^(f),r = 
0, . . . ,m — 2. This leads to the conclusion that the observation function y(t) = aq (t) 
is an element of C 2m_2 [0,T] and satisfies the boundary conditions 


y {r) ( o) =*?+!, yV(T) = xJ +v r = 0, . . . , m — 1 (4.22) 

and 

y(U) = xi(ti), i = l, . . . ,p — l. (4.23) 

Thus, y(t) is a spline function and the above discussion proves the following: 
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Theorem 4.1 Let x(t) be the solution of the system (2.11), (2.12), and (2.15) with 
Xi(ti) = (*i, i = 0, . . . , p. Then there exists a unique function y(t ) € C 2m-2 [0,T] 
that satisfies equations (4-22) and (4.23). 

4.2 Classification of Splines 

The type of spline is determined by a set of basis functions. By control principles, 
we can construct these basis functions. Now, suppose the interval [0, T] is subdivided 
into p subintervals. In this analysis, it suffices to consider just one subinterval to de- 
termine the kind of interpolation functions of the state x(t). Thus, on the subinterval 

[*o,<i] i 

x(t) = e A ^~ ta) x (t 0 ) + / e A( ' t ~ 3 ^bu(s,X)ds (4-24) 

J to 

The control law is given by Theorem (3.4): 

u(t, A) = ef (e^-^H-'r + J* e F( - l ~^a(s, A) ds) (4.25) 

From equations (3.44) and (3.46) 

G(t) = (-1)" dr) ds' (4.26) 

/<-(,) = j'~'’ is' (4.27) 

and 

C(t) = I<(t)v(h) + G(t) (4.28) 

If we substitute equation (4.25) into (4.24), we obtain 

x (t) = e ^( t_t o)£(t 0 ) + J* e^ t_s) 6 (ef (e F(t-to) // -, r + e F( - t ~ T ^cr(r) dr)) da 

= e A{t ~ to) [x° + K{t)W 2 v(h)e- ATt0 \ + G(t)e- ATt0 \] 

= e A (t-to) + (K(t)r)(h) + G(t))e- ATto e ATt *C- l e AtQ {e- At i x 1 - e^f 0 )] 

= e A{t ~ to) [f° + C(t)C~ l (h)e At ° (e~ At{ x 1 - e~ At ° x 0 )] 

= e A(t ~ to) [f° + C(t)C~ 1 (h)(e~ Afl x l - £°)] 


(4.29) 


34 


Now, since the matrix F has linearly independent eigenvectors (pi,P2, • • • ,P2n), then 
Fis similar to a diagonal matrix D = diag((3i, . . . , fan) [19]; that is, there exists a 
nonsingular matrix P such that 

F = PDP- 1 (4.30) 

Let 



( Pl,l 

Pi, 2 • 

Pl,2n ^ 


( Pi,i • • 

• • • • Pl,2n ^ 

p = 



• 

, F"' = 

. 



\ P2n,l 

P2n,2 • 

• • P2n,2n / 


\ P2n,l • 

• • ' • P2n,2n / 


Here, the columns of P are the eigenvectors p k , k = 1,2, ...,2n, of the matrix F. 
Let E be the Jordan canonical form of the matrix A. Then A = QEQ -1 , where Q is 
the matrix such that AQ = QE. Thus, further analysis is simplified by replacing the 
matrix F with PDP~ l and the state matrix A with its Jordan matrix E. Hence, we 
may write 


x(t) = Qe^-^Q- 1 [f° + C{t)C~ l {h){Qe- Eh Q- l x x - rr 0 )] . (4.31) 

Let the first row of the matrix Qe E< - t ~ t °^Q~ 1 (I—C(t)C~ l (h)) be ... , and 

the first row of the matrix Qe E ^ t ~ t °^Q~ 1 C(t)C~ 1 (li)Q(~ Eh Q~ 1 be . . . , ip m (t)). 

Now, the system (2.11) is controllable since rank(bAb . . . A m ~ 1 b ) = m. The output 
of the system is 

y(t) = e[x(t) 

= e^(e 4( ‘" <o) i° + f e Mt ~ 3) bu{s) ds) 

J to 

= Q e E (‘-‘°)Q-i + C(t)C~ l (h)(Qe~ Eh Q~ 1 x l - f 0 )] 

= (<M0. • • • > tmit))* 0 + (lpl(t), ..., V'm(O)^ 1 

m m 

= Y xlMt) + Y (4-32) 

*=1 / = 1 

By choosing x° = e k and x 1 = 0, we obtain <j)^ — i/ r )(f), r = 0, ... ,m — 
Thus, for r = 0, . . . , m — 1, 

<4 r) (°) = 2/ (r) (0) = xi r) (0) = x r+ i(0) = = 6 k ,r+i 
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4>[ r) (h) = y {r \h ) = x ( {\h) = z r + 1 (/'■•) = *J+i = °> 

fc = 1, . . . ,m. 

In a similar manner, if we choose x° = 0 and f 1 = e,, then we obtain 

ifj\t) = y (x) (t), r = l,...,m. 

Hence, 

VS°(0) = y"> = 0 
= / r \h) = « J>+ , 
j = 1 

The above discussion proves the following theorem. 

Theorem 4.2 Te< .4 5e given by equation (2.12). Furthermore, let the first row 
of the matrix Qe E ^Q~ l (I - C(t)C~ l (h)) be • • -Am{t)), and the first row 

of the matrix Qe^-^Q^C^C-^Qe-^Q- 1 be (^i(t), . • • , «*))• Then, for 
r = 0, ... ,m, 

^(0) = <t>k\ h ) = °- = 1- ’ ' ' > m 

W r) W=0< rp\ r) (h) = Si, r+ 1, / = 1, . . . , TTi. ■ 

Therefore, <£*, ip k , k = 1, . . . , m are basis functions for y(f)- These basis functions 
depend on the entries of the matrices e Et , K(t), and G(t). Hence, we can determine 
the type of spline function by carefully examining the entries of these matrices. 

Proposition 4.1 Let the state matrix A be nilpotent of order m and the cost function 
J(u) = Jq E£ = o( u(fc) ( s )) 2 ds. Then y(t) is a polynomial spline if and only if n = 0. 

Proof. To prove this proposition, we observe that the spline function y(t) is expressed 
in terms of the basis functions (f> k and ip k , k = 1, . . . ,m, equation (4.31). However, 
the basis functions themselves are dependent on the entries of the matrices e El and 
e Dt , where E and D are the Jordan forms of A and F, respectively. Now, if A is 
nilpotent, as in the proposition, then A is already a Jordan matrix and hence the 
entries of e Et are all powers of t. It then follows that the spline function y(t), which 
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is a linear combination of the entries of e Et and e Dl is a polynomial if and only if the 
entries of e Dt are all powers of t. This is the case only if n = 0. ■ 


From theorem (4.2), we see that the basis functions <fc, and are determined by 
the matrices e Et , and e Et Q~ l C{t). But these matrices are themselves characterized 
by the spectrum of the state matrix A, and the matrix F. Therefore, we will classify 
the spline functions obtained by control principles by examining the entries of A, and 
F. In this classification, we consider the case where the state matrix has dimension 
2 and the cost function J(u) = f 0 T (( u(s )) 2 4- («'(*)) 2 ) ds. For higher dimensions and 
derivatives of higher orders, the procedure is similar but more involved. So let 

A = ( 1 1 , ai,a2 € R l 

y O'! 2(* 2 ) 

b = ( 01) T . 


Then the eigenvalues of A are 


6 = Oi 2 + \foil + 


6 = «2 - y/<* 2 +«i- 

Thus the Jordan form of A and the transformation matrix Q are as follows: 

' 6 0 \ 


E = 


Q = 


l l 

6 6 


Q~ x = 


W’ 



1 / 

»/>v 

to 

-M 

ft-G \ 


1 J 

, from equation 

(3.22), 


F = 


0 1 
1 0 


with eigenvalues and eigenvectors 

A = i, ft = -i. 


Pi = 


Pi = 


37 



Also, from equation (3.10), 

B = ( 01 ) 

and on the subinterval 

M = ,*«-«<-.) = ( C ° Sh( ‘ ” ‘'- 1 ' Sinh( ‘ ” ‘‘- 1 ’ ) • 
^ y sinh(f - tj_i) cosh(f - U-\) J 


Thus, 


B<p(t) = ^ (sinh(t - U-i) cosh(£ - £j_i)) 


and from equation (3.20), we have 

Hi = 


B4>(U-x) \ 
B<KU) j 
0 1 
sinh hi cosh hi 


(4.33) 

(4.34) 



-1 

sinh hi 


cosh hi — 1 
— sinh hi 0 


where /q = ti - <j_i. From equation (3.43), 


G(t — ti- 1) 


Q 


J'-"-' e -^i(j^e^'-'" l e 2 i r e- AT '‘dr^ is' 
( 9n{t) 9n(t) \ qt 

\ 52l(0 922(t) J 


where 


9n{t) = 


-1 f-2(t-ti_i) | e( 1 ~ ^‘) (t ~ ti ~ l) — 1 


e -(i+6)(«-*i-i) _ i 


2(6-6) l 1-6 


(i - 6) 2 


(1 + 6) 2 
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-1 - 1 ) - 1 - l] 

Mt) = 2(6^6) \ (l -am -£.) “ (l- £.)(!- 6 ) + (1 + 6K1 + 6 ) J 

-i f - 1) - 1 , - 1 

h ' {t) = 2(6 - 6) \ (l-ff)(&-6) (1-6K1-6) + (l + fi)(i + 6) 


) 


2(6 

From equation (3.45), 


-1 f_2(< -ti-i) ca-feX*-**-!) - 1 c -(i+6)(*-*i-i> - 1 

¥ ' 


te(i) = { 2 f_ ;r '' + 


(1 - ? 2> 2 


(l+« 2) 2 


K(t - e- A ‘’b(^e F -') ds’ 

k n (t) k l2 (t ) \ 


where 


*n (0 = 
^12 (^) = 
^21 (0 = 
^ 22(0 = 


-1 


&21 (0 ^ 22(0 

' g(l-Cl)( J - f i-l) _ 1 e -(l+Cl)(t-t«-l) _ 1 


2 ( 6 - 6 ) 

-1 


1-6 


1 + 6 


_ 1 e -(i+Ci)(t-‘<-i) _ 1 

— + — 


2(6 - 6)1 1-6 ' 1 + 6 

1 r e (i— ) _ 1 c -(i+{i)(t-ti-i) _ 1 


2 ( 6 - 6 ) 

1 


1-6 


1 + 6 


2(6 - 6 ) 


’ _ j e - 0 + 6 )(‘-«.-i) _ 1 

- + — 


1-6 


1 + 6 


) 


Equation (3.47) gives 


«(*) = r 

Jo 

( ^12 


u > 21 ^22 


Q 1 


where 


u>n = - 


u 12 


W21 — 


sinh hi 4- cosh hi — e (lh ' 

(6-6)(i-tf) 

6 sinh hi 4- cosh hi — e~^ 2hi 

(6 - 6)(i - 6 2 ) 

sinh hi - 6 cosh hi 4- 6 e~^h, 

(6 - 6)(i -W) 


1 

9 
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U?22 

and equation (3.49) gives 


sinh hi - £2 cosh hi + & 


where 


V (h) = H"BQ(hi) 

= ( ^ ) Q T 

y i?2i %2 y 

sinh hi — £1 cosh hi + 
hl ~~ (£2 -6)(1 -^ 1) sinh ^ 

sinh h, — £2 cosh hj + 

^ 12 “ (6-6)(l-C2 2 )sinh/ii 

f?2i = 0 

7)22 = 0. 


Therefore, 


and 


K(t)n(hi) = Q 


kn(t)fln(hi) kii(t)f}u{hi) 
k 2 i(t)Vn(hi) k 2 i(t)fji 2 {hi) 


Q T 


C(t) 


G(t ) + K(t)ri(ht) 

{ gn(t) + k n (t)rj n {hi) 5i2(0 + £11(0^12(^1) 

i 5 2 i (0 + k 2 i{t)i)n{hi) 522(0 + faii^Vnihi) 


( c*n(0 c* 12 (t) \ 

\ c 2 i(0 c 22 (t) y 


Q 


c' n (0 = 5n(0 + k n (t)fin(hi) 
cli(0 = 5i2(0 + kn{t)Vu{h t ) 
c' n (0 = 521 (0 4" k2i{t)f]n(hi) 

c\i(0 = 522(0 kn(t)fin(h t ) 


(4.35) 


(4-36) 


where 
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i 


c-\h t ) = Q- t ^_ 

/ ZiVk 

V 4i (^» 

where 

|C| = (gn(hi) + kn(hi)fin(hi))(g22(hi) 4- fc2i(^)^i2(^i)) — 

(gn(hi) + kn{hi)f)i2(hi))(g2i(hi) + fc 2 i (h^Vn (hi))- 

From equation (4.32), 

e A(t ~‘° )[/ - C{t)C- x {hi)\ = ( \ 

l * * / 

where 

Mt) = {6c ( ‘ <1 “ , -‘ > - fieoc---*} - 

. 1 - [5n(^)cu(0 + c 2 i(A i )ci2(()]6e (l, ‘"‘‘- l) |C|-' + 

S2 ~ U 

— -h— [c u (/i i )c 2 i(t) + C2i(/ii)c22(0]6e f2(t_t<_,) |C| _1 - 
« - O 

— [c 12 (/ii)c u (t) + c 22 (/ii)c l2 (t)]6e fl(t " t< ' ,) |C'| _l - 

& — O 

— [ci2(/lj)c2i(t) + C22(/lt)c22(0]^l e<2 ^ 1 

« - $1 

and 

fc(J) = — l — (-«*•«-•<-) + e&<‘-‘‘->) + 

r 4_[c 11 (fc.)c„(i) +c 2l (A j )c 12 (()le ( ' (, -‘ i -' l |Cr 1 + 

S»2 “ U 

- 1 c [cn(/li)c 2l (t) + C 21 (/l t )c 22 (<)]^ 2(t " t - l) |cr 1 - 

S2 ““ <sl 

(*)*,(«) + c 22 (/ 1 ,)c 12 (()]e ( >< , - , '-‘)|C|- 1 - 

S2 - O 

7-2 — [^,(^,(0 + i4,(A j )c2jW]e*’“‘“- ,, |Cr l . 


<722 + koif)i2 ~(gi2 + fcll??12 
■(521+ ^21^11 011+fcii^n 
> c\ 2 (hi) 

I ? 2 2 ( h i) 


Q- l \c\ 


-1 


(4.37) 


(4.38) 


(4.39) 


(4.40) 


J 

] 

l| 


I 

4 

i 

1 

1 




i 

;| 


• i 

I 

( 

} 

| 

I 

t 

I 

1 

! 

f 

\ 


\ 

\ 


e A{t ~ to )C{t)C- l {hi)e~ Ahi = 


1pl(t) fait) 


*(() = + C2i(/> j )c. 2 (()]6e t,< ‘ _ ‘- ,_ '‘' l |Cr l + 

S2 

r-^-[cn(h,)c 2 dt) + c J ,(Ai)^(i)tee«- ( -“->- s ' , “>|C|- 1 - 
S2 ” fl 

— [Ci 2 (6)6l(0 + 6 2 (6)Cl2(0]6 e ^ ‘ ^ ’^1^1 _ 


6-6 

l 


7-V|Cl 2 (/li)C2l(t) + e 2 2(^)c22(f)Kie^( t -“- 1 - hi) |Cr 1 . 

S2 - U 

*(t) = -t^tIcuW^iW + c 21 (ft i )e, 2 (t)]«=* ,( ‘-“->-'“ ) |C-|- 1 - 

S2 — £l 

T-2-Mkto.M + c !1 (/. l )522(()l« ({l< '-“- ,) - £, '" > lcr' + 


(4.42) 


6-6 

1 


-i-[c 12 (6)6i(0 + cn(^)ei*W]c (Cl(l "‘ , - l>_ft * i) l c r 1 + 
6 - 6 




— — 7 - [ci 2 (ft»)6i(0 + 6 2 (6)c22(0] e ^ f *’ 1 ’^l • (4-43) 

6 - 6 

Now, let us consider the various cases that arise from the various forms of the 
eigenvalues of the state matrix A. 

Case 1: a\ + cti > 0. In this case the matrix A has two distinct eigenvalues. 

Case l(i): If 6 # 6 , then the spline obtained is an exponential spline with basis 
functions <M0, <6(0, Vh(0 and fa(t) given by equations (4.39), (4.40), (4.42), and 
( 4 . 43 ). Here, </>i(0, <6(0, <6(0 and V> 2 (0 are linear combinations of e‘, e *, e ?l( , te ?1 ‘, 
e* 2t , and te^ 2t . 

Case iftij: ^ «2 = 0, and c*i > 0, then 6 = ~6 and we again obtain an exponential 
spline. The basis functions are linear combinations of e l , e _t , e fl ‘, e~ ilt , te^\ and 

te-W. 

Case l(iii) If a t = 0, and <a 2 ^ 0, then 6 = 0, and 6 = - 2«2 if <*2 > °5 6 = - 2 a 2 , 
and £•> = 0 if a 2 < 0. The resulting spline function is a linear combination of the 
functions 1 , i, e‘, e"‘, e<", and (e-<- if a, > 0 ; or 1 , t, o', e' 1 , e'". and te^‘ if 
Of 2 < 0. 
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Case 2: a\ 4- a x <0. This case leads to two complex eigenvalues: 


Cl = C*2 + iw, 6 = <*2 - 

where u> = \J—(oi\ + c*i)- 

Case 2(i ): a 2 ± 0, «i < 0. The resulting spline has basis fucntions which are linear 
combinations of e\ e -t , e° 2t cost, e Q2t sint, te Q2t cost, and te Q2t sinf. 

Case 2(H): a 2 = 0, ai < 0. This gives 


= Z\/ — Qfi = iu) 

£ 2 = — = — iui 


and a spline function whose basis functions are linear combinations of 1, t, e l , e -t , 
cost and sint. 

Case 3: af + — 0. This implies Ci = £2 = ot 2 . 

Case 3(i): a 2 7^ 0. Then 


E = 


a 2 1 

0 a 2 


e Et = e° 2t 



Q~ l = 


1 

-a 2 


0 

1 


G(t — tj— 1 ) 


- e- As 'b (%e Fa ' f' e~ Fr ' eJF e~ ATr> dr') ds' 

-O ( ^ 

\ #2l(0 522(0 ) 


(4.44) 


where 


g n (t) = + Ate-** 1 *- 1 *-'' + A 3 


where 


g l2 (t) = Bi(t)e- 2a2(t_t< - l) + B 2 (t)e- ai{l - ti - l) + A 
g 2l (t) = Ci^e- 20 *"*- 0 + AWe"** 0 "**" 0 + C 3 
g 22 (t) = DiWc " 20 ^*-* 1 - 0 + D 2 ( 0 c" aa(l_, ‘- l) + ^>3 


AW — 


(t - Al ) 2 , t-tj-l 


a 2 (l - a!) + 2a 2 (l - a 2 ) 4<*1(1 - a 2 ) a 2 (l - a 2 ) 2 

2 


+ 


AW — 


(1 - a\) 2 

1 1 


AW = - 


Bz(t) = 


4a 2 (l — or 2 ) (1-al) 2 

t - t*-i 1 

2a 2 (l - a 2 ) 

4a 2 (l - a l) 

t - U-i 

1 

1 

a 2 (l - ocl) 

aj(l - al) 

1 

^ 9 / 9\ 

1 

_2/i ~2\ 


1 1 
+ 


Cl(i) “ “2Q,(l-if) 4al(l - a?) T (1 - a?) 2 

2 


AW = 


(l-al ) 2 


, , 1 1 
AW = — — ~ + 


4a|(l - a 2 ) _r (1 - a]) 2 
1 


AW = 


AW = - 
AW = 


2a 2 (l -or|) 

1 


a 2 (l — a 2 ) 

1 


2a 2 (l - al) 


44 


J 0 

( k n {t) knit) \ 


= Q 


fc 2 l(t) ^22(0 


k n (t) = E 1 it)e^~ a ^ t - ti - l) + E 2 (t)e- (1+Q2)(t -“- l) + E 3 (t) 
knit) = Fi(t)e (1-Qs)(t_ ‘ <_l) + F 2 it)e^ +a ^ t - u - i) + F*{t) 
k n (t) = G 1 (i)e (1 " Q2)( ‘ _ti - l) + G 2 (t)e“ (l+Q2)(t " t< - ,) + G 3 (0 
k 22 it) = H x + ft(*) 


IT / t \ _ { hzl + 

l ' ' 2(1 -a 2 ) 2(1 -a 2 ) 2 

F / t x = __Lziizi i ~ ^-L- 

' 2(1 + 02) 2(1 + a 2 ) 2 

p 2a * _ 

3_ (1-al) 2 

t — f j_ 1 1 

Fl(t) = “ 2 ( 1 - 02 ) + 2(1 - a 2 ) 2 
2(1 + o 2 ) + 2(1 + o 2 ) 2 


W) = - 


l + O 2 
(1 - alY 


Gi{t) — 


2(1 - 02) 


GM ~ 2(1 + a,) 


Gs{t) — 
Hi{t) = 


(1 - a\) 

1 

2(1 - o 2 ) 


kbit) = - 


2(1 + 02) 
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Hz(t) = 


1 

(T^|) 


Q{h t ) 


f ki e^-^e^e-^ 3 ' ds' 

Jo 

Q (C)n <i 12 \ 

^ d>2i &22 ) 


(4.46) 


where 


wn 


^21 


1 - hj(l ~ (Xi) Ji- a2 )hj _ 1 Z M 1 +<* 2 ) _(l+a»)fci _ 

2(1 -a 2 ) 2 2(1+ a 2 ) 2 (1 - «1) 2 

1 — 1 g“(l+«2 )hi — l\ 

Wl2_ 2\ 1 - a 2 + 1 + «2 J 

hi - 1 + hid 2 (1 _ Q2 ) ftj _ 1 + hip + fjg) -(l+a 2 )/ii , 2 ( 1 + Q 2 ) 

2(1 -a 2 ) 2 6 2(1 +a 2 ) 2 (1 “ a l) 2 

^ / e (l-a2)/ii __ J e ~(l-fa2)/ii — l\ 

“ 22 = 2 ( 1-aj 1 + «2 j 


Thus, 


and 





° 1 ) 
sinh /ij cosh hi J 



-1 

sinh hi 


cosh/ij — 1 
— sinh hi 0 


s sinh hi y 0 J 


r)(hi) = H['Be Fh 'Q(hi) 

/ Vn Vn \ 
\ V 21 r ]22 J 


(4.47) 


(4.48) 
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where 


i ic., 

Vn ~ V 2(1 -o 2 ) 
( hj 
V 2(1 + o 2 ) 

( 2(1 - o 2 ) 2 + 


1 

hi cosh hi 

hi cosh hi 

2(1 - o 2 ) 2 

2(1 - o 2 ) sinh hj 

2(1 — o 2 ) 2 sinh hi 

1 

hj cosh hi 

hi cosh hi ^ 

2(1 + o 2 ) 2 

2(1 + a 2 ) sinh h, 

2(1 + a 2 ) 2 sinh h, / 

1 

-r + — 

hi cosh hi 

- \ O ■ T 1 ' 

hi cosh hi ^ 

/1 . _ \9 L 1 


x » • I : ^ 

l + a 2 ) 2 2(1 — a 2 ) 2 sinh/ij 2(1 + a 2 ) 2 sinh hi 


Vn = 


+ 


cosh hi 




v 2(1 -a 2 ) 2(1 — a 2 ) sinh/ij 

*1 cosh hi \ 

2(1 + a 2 ) 2(1 + o 2 ) sinh hi/ 


1 

1 — a 2 


l — a2 


cosh hi 


sinh hi 


3 


W 21 = 0 
V 22 = 0 


IC(t - ti-i)v(hi) = Q 


kn(t)Vn(hi) kn(t)vi2{hi) 
k2i{t)vn{hi) k-2i (t')Vn(hi) 


Q T • 


This leads to 


C'{t) = K'(t)v(hi) + G'(t) 

f kn(t)vn(hi) - 9 n(t) k n (t)Vn(hi) - 5 n (0 \ 
y k2i(t)vn(hi) - 92 i{t) k2i(t)vn{hi) — 522(0 ) 

/ 4i(0 c i2(0 \ 

\ c 2 l (0 C 22 (0 / 

where 

j n {t) = k n (t)vn{hi) - 9u{t) 

c\ 2 (0 = a 2 cu(t) + k n (t)vn{hi) - 5n(0 

c l 2i (t) = a 2 Cn (0 + h 2 i(t)i 7 n(hi) — 52i(0 


| e (1 " aj),l ’4- 

— (1 +Ot2 )hi __ 

(4.49) 


(4.50) 


(4.51) 
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c 22^) = a 2 c 2i(t) + <*2(^11 (t)Vu{hi) ~ 9 n{t)) + ^21 {t)vn(hi) - 922^) 


C-\h { ) = Q 


^21^12 ~ 922 ~ {kn'Hu — 5 i 2 ; 

— (^ 21^11 — # 21 ) ^ 11^11 — <?n 

^ll(^i) c l 2 (^») 


Q -^ cr 1 


(4.52) 


where 


|C| = (fcn(hOmi(^) - 9n(^«)) (* 2 i(h,)T?i 2 (hi) - 922 {hij) - 
( k n {hi)T)n{hi ) - gi 2 (/ij)) (fc 2 i(^.)^ii(^t) - hii h ij) • 


Now 


C{t)C~\hi) = 


c ll(0 ^12 (^) \ ( ^ 12 (^ 1 ) 

c 2 lW C 22 ^) / \ ^21 (^*) c 22(^0 

?n(h)cn(t) + ^21 (^i) c i2 (i) ^i2(^i) c n(0 ^ ^ 22 (^*) c i2 (^) 

C l n {hi)C2l(t) + C2i(^i)C22(^) C l l2(^ l i) C 2l(0 + ^22(^*) C 22 (^) 


gAO-ti-x) [/ _ C(<)C -1 (/li)] = ^ 


<M0 fait) 

* * 


(4.53) 


(4.54) 


where 


fait) = e Q2(e '‘’- l) {(1 - a 2 (t - 1)) (l - cii(M c n(*) “ 4 i( fc i)cw( 0 )} 

|(t _ t._ x ) (ci^/i^cj!^) + 4(/ii)c 22 (t))} (4.55) 

<£ 2 (f) = e ai(t ~ u - x) {-(1 - a 2 (t - *<-i)) ( 4 (/i t )c n (*) + c‘ 22 (/i t )ci 2 ( 0 )} + 
e a 2 ( t -t,-x) {(* _ t ._j) (1 _ e i2 (hi)cn (t) - C* 22 (^) c 22 ( 0 )} ( 4 ‘ 56 ) 


Similarly, 


e A(t-t,-,) C ( f ) C -l(^.) e -^ _ 


iMO ^ 2(0 


* * 


(4.57) 
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where 

^(i) = e^d-u-i-hi) _ Q ^ t _ t i _ 1 ))(l + ttjfci) (cii(^)cn(O + c^i(/ii)ci 2 (i))} + 
e a 2 (t-ti-i-hi) + a 2 hi) (c* u (/ii)c 2 i(0 + ^i(fci)caaW)} + 

e a 2 {t-ti-i-hi) — Q ; 2 (f — fj_i)) (c\2(^ l *) C H (^) ^22 (^ l ») c 12 (^)) } + 

e a 2 (t-ti-i-h,) { a 2 h . (e n (hi)C2l(t) + 4 2 ( /l *) C 22(i))} ( 4 ‘ 58 ^ 


- 0 2 (t) = e Q 2 ( t-t <-> hi ' ) |-/ii(l - a 2 (t - tt-i)) ( c n(^i) c u (0 + ^ x (/»i)ci 2 (i))} 
e a 2 (f -ti-i-hi) { h .( t _ t ._ j) (ci^i)^) + 4(k)c 22 (t))} + 

h x _ tt2 ft.)(i _ a 2 (i - *<_!)) (c* 12 (^i) c ii(0 + C l 22 (/i i )c 12 (t))} + 
e a 2 (t-ti-i-hi) _ a2 /j.) (ff l2 (hi)C2i(t) + C^ 2 (^»)c 22 (t))} . (4.59) 

Thus, the resulting spline has basis functions which are linear combinations of 1, t , 

t 2 , e- Qjt , te- Q2f , e- 2a2t , te" 2Q2t , t 2 e" 2 “ 2t , fe< l -“ 2)t , e^ 1+a2)t , 

Case 3(ii): a 2 = 0- In this case, the state matrix is in Jordan form and hence, G(t) 

and K(t) may be computed directly as follows: 



On the subinterval 



H - 1 = 


— cosh hi 1 


sinh hi \ sinh hi 0 


jr _ 1 1 

1 sinh/ij \ 0 


(4.60) 


(4.61) 

(4.62) 
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where 


Also 


where r/n 


where 


Q(/ij) = f e F(/li aT *' ds 1 

Jo 

_ f ^11 w 12 j 

y o? 2 i OJ22 J 


(4.63) 


cjji = hi — sinh/ij 
o/ 12 = cosh hi — 1 

U 21 = ~ u} 12 
U>22 ~ si n h hi- 


rj(h t ) = H"LlQ,(hi) 


1-cosh h,j 
sinh hi ’ 



( ^11 

V12 \ 

(4.64) 


\ V21 

V22 j 


II 

s? 

H 

II 

CN 

£ 

0, and r]22 

= 0. From equation (3.45), 


/v(*) = 

f e~ As 'b | 
Jo 

(efe**) ds' 

(4.65) 


( k n (t) 

ki2(t) \ 

(4.66) 


V fc 2 i(<) 

^22 (t) J 


k\i (£) — —t sinh t + cosh t — 1 
/c 12 (f) = Fcoshi — sinhf 
^21 ( t) = sinh t 
fc 22 (t) = coshf — 1 


K ' ihi ) 


f -hi sinh(/ij)+ -/i, cosh(/ij)+ \ 
cosh(/ij) — 1 — sinh(/ij) 


y sinh(/i,) 


cosh(/ti) — 1 / 
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K^tHhi) = 


kn(f) A:i2 (0 \ 
^21 (*) k 22 (t) ) 


(4.67) 


where 


From equation (3.43), 


k n (t) = k n {t)r)n 
k l2 {t) = k n (f)Vi2 
k 2 i (t) = k 2 i(t)r]n 
k 22 (t) = k 2 i(t)r)i 2 

vi<h\ <h\-( kuW 

K (kWh) y ^ h) fc 22 (h) J 

rt-ti 


where 


G\t) = (— 1 ) J e (^1 f 0 eF ^ r ^ 2 ^ r e A r< ^ r ) ds 

( 9n(t) 9n(f) \ 

\ 021 (t) 922 (t) ) 


g n (t) = \P + sinh t - t cosh t 
o 

p - 

g l2 (t) = coshi + tsinht + 1 

2 

P 

921 (f) = cosh t — 1 - — 

922 (f) = t — sinht 


( \h 2 + sinh (hi)- — cosh (h,)+ \ 


G'ihi) = 


hi cosh(/ij) 


hi sinh(/q) + 1 


^ cosh(/q) - 1 - ^ hi - sinh (hi) ) 


(4.68) 

(4.69) 
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Thus, 


C*(t) = K^Fjvihi) + <?(t) 

_ ( kn{t) + 9n{t) k x2 {i) + g x2 {t) 

y k 2 \(t) + 521 (^) k 22 (t) + §22{t) 

l Cii(t) C\ 2 (t) \ 

V 4l(*) C 22^") / 


i /T\ (t sinh t — cosh F + 1) (cosh hj — 1) P_ ?cosh ? + sinh f 

c nW = ^h/^ 3 

P 

^12 (^) — _ " 2 ^ 

4 (f) = - 1 -i-^ cosh,, ’- 1) + coshf 
4 2 (^) = ^ 

^ ^ ^ j — . . . t n — 1. Hence, when t = ii, we obtain t = hi, and 

Ci{hi) = K i {h i )r)(h i ) + G i (h i ) 

I kn(hi) + gu(hi) knihi) + guihi) \ 

^ k 2 \(hi) + 521 (hi) h 22 (hi) + 52 2 (hj) / 

_ / c ii(hi) c \ 2 {hi) \ 

\ c 2l(hi) c 2 2 (hi) I 


Furthermore, 


1 ( cL(hi) -c\ 2 (hi) 

c-mm = mr 4;^ 4 (W 


cn(hi) c 12 (hi) 
c 2 i{hi) c 22 {hi) 


where d(Ci(hi)) denotes the determinant of Ci(hj)) and is given by 

d{Ci(hi )) = c n (hi)c 2 2(hi) - c l2 (h i )c 21 (h i ). 
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Therefore, from equation (4.31), we have the following: 


e At _ e Af Ci (t) C -l( ht ) = 


1 M | c n (t)c n + Ci 2 (t)c 2 i c n (t)c 12 + c l2 (t)c 2 2 

0 1 ) y c 2 i(t)cn + c 22 (F)c 2 \ c 2 i(t)ci 2 + c 22 (t)c 22 

01 (0 02(0 \ 


where 


0i(O — 1 — [cn(i)cn +ci 2 (t)c 2 i +i(c 2 i(t)cn +c 22 (t)c 2 1 )] 


02(0 —t— [c u ( 0 ci 2 + c n (t)c 22 + t(c 2 \(t)c\ 2 + c 22 (t)c 22 )}. 
Substituting for Cjj(t), these equations simplify to: 

_ _ _ f 2 _ P r .,- (1 — cosh t) (cosh hi — 1), 

0 i(0 = 1 + Cut — c 2 i~ + Cn^r ~ c n [smh t 4 sinh^ 


_ P t 3 .. , - (1 - coshO(cosh/ij - 1) 

02(0 = (1 + Ci 2 )f — c 22 — + c i 2 ^r — c i 2 [smh t H sinh/i^ 

Similarly, 


e^OCf 1 ^)^ = Q [ j x 

/ Cn(0^11 4" c 12 (0^21 c ll(0^12 + <h 2 (0c 2 2 | f 1 

y c 2 i(0cn + c 22 (0c 2 i c 2 i(0ci 2 + c 22 (0c 2 2 / \ 0 1 

f 0l(O 02(0 ^ 


* ★ 


where 


01 (0 = [cil(0 f 'll + C 12 (0 c21 + t(c 2 i(l)c n + C 22 (0c 2 l)] 
= 1 01 (0 
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and 

" 02 (f) = -hi[cn(t)cn + ci 2 (f)c 2 i 4- f(c 2 i(t)cn + c 22 (f)c 2 i)]+ 

[cn(f)ci 2 + Cj 2 (f)c 22 + t(c 2l (i)c l2 4- c 22 (t)c 22 )] (4-81) 

= — hi(l — 0i(f)) + t — 0 2 (i). 

Thus, the spline obtained has basis functions which are linear combinations of 1, t, t 2 , t 3 , e‘, 
and e _t . 


CHAPTER V 

CONVERGENCE AND NUMERICAL RESULTS 


Here, we will examine convergence rates for the spline approximant for case 3(ii) 
and then give the results of computer simulations. 


5.1 Results for a Nilpotent Matrix 

Since the state matrix under consideration is 2 x 2 (that is m = 2), then it follows 
that r = 0, and, from equation (4.18), the requirement u\ r \ti) = uj+\(ti) yields the 
following: 

Mi{hi) = 


ef A ii(hi)e Ati -'C- 1 = ( d t a) (5.2) 

%M i (h i )e ATti -'C- 1 e- Ahi = (d i -hidi + ei) (5.3) 

where 


e Fh H"BVl{hi)e~ ATti ~ i - tl{hi)e~ ATti - x 

(e Fh H”B - /)Q(/i)e _ ^ Tti - 1 

f _1 cosh \ ~ 

' ■ l "‘ «( K)e- A 


(5.1) 


/ X 


d{ = [— u x n + 
a = [-o/ u + 


cosh hi 
sinh hi 
cosh hi 
sinh hi 


w 2il c Ii T [ W 12 T 


**4l. c 12 *h . w 12 T 


cosh hi 
sinh hi 
cosh hi 
sinh hi 


u 22l C 21 

^22)^22 


(5.4) 

(5.5) 




H^BQih^e 


- a t u 



sinh h*+i 
0 


n(h)e- ATt ' 


(5.6) 
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e r Mi + i(/ij+i)e A l 'C 1 — ( di+i e i+ \ ) 
Mi+i(hi + i)e ATt 'C~ l e~ Ahi+l = ( d i+l -hd i+1 + e l+1 ) 


where 


ft+i 

Cj+l = 


&2X C 11 * ^22 £21 

sinh hi+i 

^21 C 12 ' ^22 C 22 

sinh /ij-j-i 


(5.7) 

(5.8) 

(5.9) 
(5.10) 


gM i (h,)e- AThi C-'e~ M ‘ +fM M (h w )e ATh ‘*'C 1 = ( d, + e, -Mi + <U + e» ) 

(5.11) 

Substituting in (4.18), with x 1 = ( a, ft ) , we obtain 

— ( di e* ) ^ p 1 ^ + ( di + ft+i —hid{ + ej + ej+i ) ^ ^ J 


( ft + i — h i+ xd i+ i + ej + i ) 

i = 1 1. 


«i+i 

ft+i 


= 0 


( 5 . 12 ) 


This gives 


-ejft_i4-(-ftft+ei+ei + x)ft— (-hj+ift+i+ej+Oft+i — (ft+ft+Oai+ft+i^i+i 

(5.13) 

y z u u . . . u ^ 

x y z 0 ... 0 

Ox y z ... 0 


0 0 ... x y z 


\ 

( Pi \ 

( 


P 2 



A 



ft- 2 


/ 

V ft- 1 ) 

V 


D i 

— ('^2 + ^ 3)^2 + d^QCs 

d 3 or 2 — (ft + ft)c*3 + ft a 4 


Dp-2 
Dp - 1 


(5.14) 
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where x — — e*, y = —hdi 4 e* + e; + i, and 2 = — (— hd i+ i 4 e t +i), 

D\ = d\Oio — (d\ 4 d2)a\ 4 d^cti 4 - ^iPo, 

Dp — 2 — dp—20tp—3 (dp -2 4 dp—i^otp — 2 4 dp—iotp—i , 

and 

Dp - 1 = dp-iOtp-2 — (dp - 1 4 d p )o!p_i 4 d p a:p 4 (— /idj+i 4 ej + i)/? p . 

Lemma 5.1 The coefficient matrix in equation (5.14) is strictly diagonally dominant 
and hence nonsingular. 


On solving the above system of equations for (3 , we then apply equation (4.32) to 
get, on each subinterval the spline function 

y(t) = Cii-\(f>\(t) 4 fa-\fa(t) 4 Oifa(t) 4 fafa(t) (5.15) 

Here, fa, fa, fa, and fa are given by Theorem (4.2). 


5.2 Convergence of the Approximation 

In this analysis, we will denote by s(t ) the spline approximant, obtained by control 
principles (given by equation (5.15)), of the function f(t). Error estimates for the 
classical cubic spline have been discussed extensively; see, for example, references 
[11, 19, 20]. In this section, we will obtain the convergence rates for our approximation 
for case 3(ii); similar procedure will yield the error estimates for the other cases. 
Furthermore, we restrict our analysis to the case of uniform mesh with mesh width 
h. From equation (5.13), the spline approximation s(t) satisfies the equation 

xPi-i 4 yfa 4 zfa + 1 = diOi-x - (di 4 d i+ i)ati 4 d i+ ia i+ i (5.16) 

where x = -e it y = -hdi + ei + e i+ i, and 2 = -(-hd i+ i+e m ). Now, s(t) interpolates 
f(t) at the mesh points P : t 0 < <i < . . . < tf] in other words, s(t,) = = f(ti). 

Clearly, fa = s'(ti). Hence, equation (5.16) can be written as 

xs'_! 4 ys\ 4 zs ' i+ 1 = dji-i - (d { 4 4 eji+i 


(5.17) 
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where s' = s'(tj) and fc = f(U). For h sufficiently small, we have the following: 

/> 3 

0/n = h ~ s i n h h « — — 

h 2 h 4 

a/12 = cosh /i - i « y + 24 

a /21 = -coshh + 1 « -y - — (5-18) 

6 J 22 = smh h 

where, for each truncation, we have omitted terms that are of higher order in h than 
the ones retained. Also, from equation ( 4 . 71 ): 

Cn (h) = — + smhh-h- (cosh/i - l) 2 /sinh/i 

3 

cn(h) = -j 

*.<*) = < 519 > 

C22(^) “ h* 

Thus, 

detC = C 11 C 22 ~~ ^ 12^21 

= /i 4 /12 + hsinh/i — h 2 — h(cosh.h — l) 2 / sinhh (5.20) 

« /i 6 /120 

c u = c 22 /det(C) « 120//i 5 
ci 2 = —c\ 2 /det(C) ~ 60/h 4 

c 2 i = —c 2 i/det(C) ~ 60/h 4 (5.21) 

c 22 = c n /det(C) « 30//i 3 

cosh/i . , , cosh/i , 

d ‘ = + l “^‘ ! + itohA W22|C!l 

« — 5//1 2 

, cosh/i , f , cosh/i 

e ' = l - Wl1 + iM ^ 12 ' 2 ' 1512 + ^ + iiShfc 1 " 221 22 
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^i+l 


-3/2 h 

^21^11 + ^22^21 
sinh h 

5 //i 2 


e i+i 

Thus, we obtain the 


l ^ 21 c 12 + W22C22 
sinh h 
« 7/2/i. 

following: 


(5.22) 


— hd x *+■ ■+■ fii+i — 14/2/l 


— h^t+i + ^i+i 


-3/2/i. 


(5.23) 


Theorem 5.1 Let f(t) € C 3 and let 6(t) = s(i) — /(t) be the error that results when 
f(t) is interpolated by the spline s, defined above, on the partition P : 0 = to < t\ < 
... <t p = 1. Then there exists a constant K such that 

l» - /I < KW/^Wh 3 (5.24) 


To prove Theorem (5.1), we first discuss the following lemma. 


Lemma 5.2 Let P be any partition of the interval [ a,b\ . If f(t) G C 3 [a, &], then 

\AU) - nu) I < ^ll/ <3) (f.)ll (5.25) 

for each node ti, i = 0, 1, . . . ,p and 1 < ^ < t{. 


Proof: 

Using equation (5.23), 


3 

2 h 


equation (5.17) may be written as 


14 , 3 , 

+ 2 %< + 2^'+’ 




(5.26) 


This simplifies to 

3s'_i + 14s' + 3s' +1 = - / i+ i) (5.27) 

where we have used the interpolation data at, = fi. Suppose that each term of the 
form fl ± j is expandable as: 


/<;>, = + y/( r+2) ±^/< r+1) + 


f( r + 4 ) 4. 

24 
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Then, it can easily be shown, using Taylor’s formula, that 

•u 2 

3 fU + 14/' + 3/' +1 = 20/' + — (/"’«_) + /'"«+)) (5.28) 

ti_i < £ < ti+\. If is continuous on [xj_i,Xj + i], then by the Intemediate Value 
Theorem we may write 

3//_i + 14/; + 3/; +1 = 20/; + 3 h 2 /"'(0 ( 5 . 29 ) 


Let s' — /,' = 2?*. Then, subtracting equation (5.28) from equation (5.27) and 
replacing // with ^[/i+i - /*-i] - y/ 3 (£)> we obtain 


That is, 


where 


3^_ 1 + 14 E i + 3^ i+1 = y /( 3 )(0 

GE = H 


14 3 0 0 

3 14 3 0 

0 3 14 3 


0 ^ 

0 

0 


0 0 ... 3 14 3 | 

\ 0 0 ... 0 3 14 / 


(5.30) 

(5.31) 


and Hi — y-/^(0* ^ we multiply both sides of equation (5.31) by the matrix 


D = diag( 1/14, . . . , 1/14), 


we obtain 

DGE = DH (5.32) 

and 


DG 


I + B 
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1 

3/14 

0 

0 

0 ^ 

3/14 

1 

3/14 

0 

0 

0 

3/14 

1 

3/14 . . . 

0 

0 

0 


3/14 1 

3/14 

0 

0 


0 3/14 

1 / 


where ||B||oo = 6/14 < 1. Thus, ( DG ) 1 = (I + B) 1 exists, (see reference [31], p61). 
Hence, 

Halloo = ||(DG)- 1 M|| 00 

< ||(L>G)“ 1 || 00 ||L>|| 00 ||/f|| 00 

5 < 5 - 34) 

< ^ll/ (3) ll 

(4/27/i 2 ||/^ 3 ^|| for the classical case, see reference [19]). ■ 


Now, to prove Theorem 5.1, we observe that 6(t) = s(t ) — /(f) € C 2 and since 
s(fj) = /(tj), i — 0, 1, . . . , p, we obtain, by the Mean Value Theorem, 


«5(f) = f 6'(r) dr (5.35) 

Jti - 1 

This gives 

ll*WII < f \6'(r)\dr 

Jti-i 

< H^ll max |(f — tj-i)| (5.36) 


From equation (5.34), 


Hence, 


ill'll < ^n/ ( 3 ) ii- 

ll««ll < ^ii/ ,3) ii 


(5.37) 


This completes the proof of the theorem. 
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5.3 Numerical Examples 

ALGORITHM FOR CONSTRUCTING THE CUBIC-EXPONENTIAL 1 SPLINES 
To construct the spline interpolant s(t) for the function fit), defined at the nodes 
t 0 < ti < . . . < t n , satisfying s'(t Q ) = f'{t 0 ) and s'(t n ) = f'(t n ) : 

INPUT A, b, F, B, n; t 0 , h, f„; a x = f(t i), = /(t„_ i); Po = /'(to); 

A. = /'(tn). 

OUTPUT ft, Jfe = l,2,...,n-l. 

Recall, from equation (5.15), 

s(t) = ai-i<f>\(t) + Pi-i<f>i{t) 4- O'.V’i (t) + PMt) for t,_i < t < t, 


Step I For 2 — 0, 1 , . . . , 72 1 set /i, — tj t ^ — 1 . 

Step II Compute ft(h,), C(t), <f> it and ^i, 2 = 1,2, from equations (4.63), (4.70), (4.77), 
(4.78), (4.80) and (4.81), respectively. 


Step III Set 


, r i cosh hi . r t . c °sh hi , 

di = [-w n + . u ^ w 2iJ c n + \~ u n + 77m _cj 22j c 2i 


Ci = [“ wji 4- 


sinh /ii 
cosh hj i , i 


sinh h{ 


^ 21. C *12 . ^12 + 


sinh hi 
cosh hi 


sinh hi 


Li/ ‘2 C. 


22 


di + i — 


^i+1 


^21 C 11 ^22 C 21 
sinh /i^ + i 

^21 C 12 » ^22 c 22 


sinh 

where ufy and Cij are the entries of the matrices ft and C, respectively. 


Step IV Set /1 = d\OiQ — (d 1 4- df)oii 4- d%oi 2 4- e-iPo, and 
/„_l = d n _iO; n _2 — (d n _i 4- d n )o; n _i 4- d n a n + eipo, 

Step V Set lj = djCtj - 1 — ( dj 4- dj +i )dj 4- d ]+ \Oij+\ 
j = 2 , . . . , n — 1. 

Set Lj — (7 1 , ^2 > • • • > fn— 2 ) tn — 1 ) • 


! So called to reflect the fact that it contains cubic polynomials as well as exponential terms 
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Step VI Form the tridiagonal matrix, M, with: 
lower diagonal elements, -ej, 
diagonal elements, (—hjdj + ej + e_j + 1 , and 
upper diagonal elements, —(—hjdj+i + ej + 1 ). 

Step VII Solve the system M/3 = L. 

Step VIII OUTPUT ft, j = 1,2, . . . , n - 1. 

Example 5.1 f{t) = sin(M) 

Consider the test function 

f(t) = sin(M), t € [0, 1] 

We set the boundary conditions: 

A) = -7T, = *■ 

and then construct the spline function for h — 0.2,0.1,0.05. Graphs of the spline 
function s(t) are shown in Figures 5.1 - 5.3. 

Example 5.2 f(t) = e -30 ' 3 

Consider the test function 

m = e' 101 ’. t € [ 0 , 1 ] 

We set the boundary conditions: 

Po = 0, /3 P = — 30e _1 ° 

and then construct the spline function for h = 0.2,0.1,0.05. Graphs of the spline 
function s(t) and its derivative are shown in Figures 5.4 - 5.6. 

Example 5.3 For our third example, we consider the function 
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m = I 



if —1 < t < 0 
if t = 0 
if 0 < t < 1. 


We set the boundary conditions: 


A) = 0, & = 0 


and then construct the spline function for n = 80. Graph of the spline function s(t ) is 
shown in Figure 5.7. In Figure 5.8 is the graph of this same function using the classical 
quintic spline. Comparing these two figures, we see that there is an improvement over 
the classical quintic approximant. However, we must realise that the scheme used to 
obtain Figure 5.7 contains only cubic terms. Further, only the first derivative of 
the control law is used in this case. Increasing the order of the derivatives of the 
control law used in the cost function, J(u), will result in greater smoothness of the 
interpolant. 
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